Virtual reality enhanced through browser connections

ABSTRACT

Systems and methods for enabling a visitor to access VR representations authored by different authors of locations in a virtual universe via a computer network are provided. A plurality of VR data sets may be stored. Each VR data set may define a VR representation of a location, as well as world wide web data and may be independently authored by a respective author different from the other authors. One or more VR data servers may be adapted to access and transmit the VR data sets, and each VR data set may be associated with a VR data server for access to the VR data set. A domain server may be adapted to access and transmit domain data comprising the location within the universe of each VR representation and the network address of the VR data server associated with the VR representation. Further, a client host may be adapted to communicate with the domain server to receive domain data representing the network address of the VR data server associated with a selected VR representation, the client host further adapted to communicate with that VR data server to access the VR data set defining the VR representation without leaving the virtual universe.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation and claims the prioritybenefit of U.S. patent application Ser. No. 14/147,436 filed Jan. 3,2014, which claims the priority benefit of U.S. provisional patentapplication 61/786,553 filed Mar. 15, 2013 entitled, “Virtual RealityEnhanced Through Browser Connections,” the disclosures of which areincorporated herein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates generally to computer-generated virtualreality representations of locations. Specifically, the presentinvention relates to storing, organizing, and providing access to anumber of virtual reality representations via a computer network whereeach on the representations also has real time web data associated withthe selected representations.

2. Description of the Related Art

Virtual reality (VR) models and simulates views from a location invirtual space. The visitor perceives the view from virtual space on acomputer monitor or specialized display, and experiences “movement” bychanging position or orientation within the virtual space. The visitormay even be “teleported” to different points in the virtual space.

Although recognized as having substantial potential, virtual reality hasremained limited because the virtual reality data representations areusually related to authors who have previously populated the virtualreality datasets and this data is old after its authored and verylimited in terms of images, videos and the like.

A virtual reality representation models a single volume, area, or pointwithin virtual space. The representation may model physical space, suchas a location or region on the Earth, or may model imaginary space in avideo game. The visitor can move around in the virtual space, but islimited to remaining in that virtual space and the data authored by theauthor in the past.

In particular, it would be desirable that the representations beannotated with up to date information and not be limited to legacyauthored data. Given the vast amount of data on the world wide web, itwould be desirable to have access to that vast data source when viewinga virtual reality pre authored database.

Thus there is a need for adding world wide web data to virtual realitydata sets.

SUMMARY OF THE CLAIMED INVENTION

The invention is a network capable of connecting virtual realityrepresentations together to form a virtual universe. The virtual realityrepresentations can be in a simplified virtual reality format thatrequires no special computer programming or graphics skills to create.The virtual reality universe is connected to real time world wide webdata.

A network in accordance with the present invention includes a number ofvirtual reality representations, each virtual reality representationrepresenting a location in a virtual universe and defined by VR datastored on the network at a network address, where the VR data also hasthe information necessary to connect to world wide web data associatedwith the location in the virtual universe.

A database stores the network address and the location in the universeof each virtual reality representation. A database server providesaccess to the database. The database server generates a list oflocations in response to a location query from a visitor, and providesthe network address of the virtual reality representation of a selectedlocation.

The visitor connects to the network using a client host adapted tocommunicate with the domain server. The host receives data representingthe network address of the VR data server associated with a selected VRrepresentation. The host is also adapted to communicate with the VR dataserver to access the VR data set defining the VR representation.

In using the network, the visitor is preferably presented with a mapdisplaying locations in the virtual universe. Each location isassociated with a virtual reality representation accessible through thenetwork. The visitor selects a location on the map he or she desires tovisit. The domain server receives the selected location and retrievesfrom the database the network location of the data server providingaccess to the selected virtual reality representation. The domain servertransmits the network address of the data server to the host, and thehost communicates with the data server to receive the VR data definingthe virtual reality representation. The visitor may then select to viewrelated world wide web data. Upon selection, the world wide web datastrings for web data, news data and image data is obtained and populatedin the window associated with the VR location map data.

In one possible embodiment, the client host includes a monitor thatdisplays the map and the virtual reality presentation as well as theworld wide web data generated from the VR data. In other possibleembodiments the virtual reality presentation can utilize specializedhardware separate from the map display.

In preferred embodiments of the present invention, the network storesdata representing paths in the virtual universe. A path is defined by atleast two different locations in the universe. When the domain serverreceives a message from the host requesting virtual movement from afirst location to a second location, the domain server communicates thenetwork address of the data server associated with the second locationto the host. The host then communicates with that data server andtransitions from the first VR presentation to the VR presentation of thesecond location. The visitor perceives a substantially continuousmovement along the path from the first location to the second locationwithout leaving the virtual universe.

Paths can be defined in different ways in alternative embodiments of thenetwork. The domain server can store predefined path definitions bystoring a list of the locations defining the path. Alternatively, thedomain server stores a data record for each location in the universe.The data set records the adjacent locations in the universe to define apath from each location to adjacent locations. In other alternativeembodiments the path is defined in response to system events and thenmade available to the visitor.

The network preferably includes administrative software that enables newvirtual reality representations to be added to the network. The virtualreality representations can be stored on existing data servers on thenetwork, or stored on data servers that are themselves added to thenetwork. The database is updated to reflect the new locations in thevirtual universe and the network addresses of the data servers accessingthe representations.

In one advantageous embodiment of the present invention, the virtualuniverse is divided into public and private regions. Any author can addto the network a virtual reality representation of a location in thepublic region of the universe. Only authorized authors can addrepresentations in private regions of the universe.

In another advantageous embodiment of the present invention, the networkis operated as a self-regulating virtual reality universe. The networkpreferably provides visitor access to a number of virtual realityrepresentations, each authored by a different author. The domain serverreceives ratings from visitors to the quality of the virtual realityrepresentations they visited, and assesses the quality of each virtualreality representation based on the ratings provided by the visitors.

Action is then taken regarding a virtual reality based on the assessedquality of the virtual reality representation. The quality can be ratedas a running average of visitor ratings. If the rating falls below apredetermined score, visitor access to the representation can be removedor the representation can be removed from the network. Preferably theaction is taken automatically and without human intervention so that thenetwork is self-regulating.

To simplify creation of virtual reality representations, the VR data canbe stored in a simplified file format that stores digital photographstaken from a specific geographic location. An author takes a number ofphotographs from the location with a digital camera. The photographs arepreferably in JPG format but other “digital film” formats can be used.Each photograph preferably is taken in a different viewing direction,preferably viewing north, south, east, and west. The images are uploadedto the network along with geographical data (for example, latitude andlongitude) that identifies where the photographs were taken. The domainserver stores the images, the viewing direction associated with eachimage, and geographical data in a single data file on a data server. Thedomain server updates its database, associating the geographicallocation with a virtual location in the virtual universe. The virtualrepresentation is now accessible to visitors, and the photographs aredisplayed when generating the virtual reality presentation of thevirtual location.

A virtual reality network in accordance with the present inventionoffers many advantages. A number of different virtual realityrepresentations are made available to visitors through a single,centrally accessible domain server. The virtual reality representationalso has data strings (for searching the world wide web) associated withthe representation allowing the visitor to choose to see the associatedworld wide web data. The domain server enables visitors to experiencevirtual reality representations created by different authors, and totour a virtual universe created by logically organizing and connectingthe separate representations.

Authors can easily add new virtual reality representations and datastrings (for searching the world wide web) associated with the virtualreality representations for the network, enabling visitors to experiencea virtual reality universe that grows richer and richer with time butalso has up to date real time data. With the simplified VR file format,persons may share with others their travels to places around the world,or may easily create their own virtual universe for business or privateuse.

Other objects and features of the present invention will become apparentas the description proceeds, especially when taken in conjunction withthe accompanying eight drawing sheets illustrating an embodiment of theinvention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic view of a virtual reality universe realized as adistributed location network in accordance with the present invention;

FIG. 2 is a schematic view of a virtual reality representation recordused in the network shown in FIG. 1;

FIG. 3 is a schematic view of a virtual reality record used in thenetwork shown in FIG. 1;

FIG. 4 is a sequence diagram illustrating a visitor utilizing a clienthost communicating with the network shown in FIG. 1 to view a locationin the virtual universe;

FIG. 4A is a sequence diagram illustrating a visitor utilizing a clienthost communicating with the network shown in FIG. 1 to view a locationin the virtual universe specifically allowing access to the world wideweb;

FIG. 5 is a view of the client host display displaying a map of theuniverse and a virtual reality presentation of a location in the virtualuniverse;

FIG. 5A is a view of the client host display displaying a map of theuniverse and a virtual reality presentation of a location in the virtualuniverse and a presentation of the associated world wide web data;

FIG. 6 is a sequence diagram similar to FIG. 4 illustrating a visitormoving along a path in the virtual universe;

FIGS. 7a and 7b represent paths in the virtual universe extendingbetween adjacent locations in the universe;

FIGS. 8-10 illustrate other paths in the virtual universe; and

FIG. 11 represents photographs that define a simplified virtual realityrepresentation of a physical location modeled in the virtual universe.

DETAILED DESCRIPTION

Users or visitors may use any number of different electronic computingclient devices, which can include, but is not limited to, generalpurpose computers, mobile phones, smartphones, personal digitalassistants (PDAs), portable computing devices (e.g., laptop, netbook,tablets), desktop computing devices, handheld computing device, or anyother type of computing device capable of communicating over acommunication network. Such devices are preferably configured to accessdata from other storage media, such as, but not limited to memory cardsor disk drives as may be appropriate in the case of downloaded services.Such devices preferably include standard hardware computing componentssuch as, but not limited to network and media interfaces, non-transitorycomputer-readable storage (memory), and processors for executinginstructions that may be stored in memory.

FIG. 1 illustrates a distributed location network 10 in accordance withthe present invention.

The network 10 enables a visitor to visit and explore a virtualuniverse. FIG. 1 illustrates a map 12 of the virtual universe displayedon a visitor's computer monitor by a software program or virtual realitybrowser (VR browser) 14 running on a visitor's computer 16 connected asa network client. The universe can model a real or tangible space, suchas the surface of the Earth, with the universe representing real ortangible locations in physical space. Alternatively, the universe canmodel an imaginary space, such as L. Frank Baum's Oz or a stick model ofa protein molecule, with the universe representing imaginary locationsin nonphysical space.

The network 10 is preferably a local, proprietary network (e.g., anintranet) and/or is alternatively a part of a larger wide-area network(e.g., the cloud). The network 10 can be a local area network (LAN),which is communicatively coupled to a wide area network (WAN) such asthe Internet. The Internet is a broad network of interconnectedcomputers and servers allowing for the transmission and exchange ofInternet Protocol (IP) data between users connected through a networkservice provider. Examples of network service providers are the publicswitched telephone network, a cable service provider, a provider ofdigital subscriber line (DSL) services, or a satellite service provide.

The visitor explores the universe by selecting and viewing virtualreality presentations of virtual locations or points 18 on the map 12.Each point 18 represents a location in the universe that has at leastone virtual reality representation available for a visitor to access andexperience. A point 18 can model a point, area or volume in the virtualuniverse, and a visitor may be capable of moving about the area orvolume if the virtual reality presentation enables it.

The VR browser 14 retrieves the data for the virtual realityrepresentations from virtual reality data servers (VR data servers) 20.VR data servers 20 are connected to the browser 14 by networkconnections 22. The network connections 22 may be through a Local AreaNetwork (LAN) or a global network such as the Internet. VR data servers20 may include any type of server or other computing device as is knownin the art, including standard hardware computing components such asnetwork and media interfaces, non-transitory computer-readable storage(memory), and processors for executing instructions or accessinginformation that may be stored in memory. The functionalities ofmultiple servers may be integrated into a single server. Any of theaforementioned servers (or an integrated server) may take on certainclient-side, cache, or proxy server characteristics. Thesecharacteristics may depend on the particular network placement of theserver or certain configurations of the server.

Each VR data server 20 provides access to VR data 24 for a virtualreality representation of the selected point 18. Data can be stored inconventional virtual reality file formats such as QUICKTIME, X3D, VRML,and the like, or can be stored as separate digital image files. VR data24 can be stored on the VR data server 20 or stored on additionalnetwork data servers (not shown) distributed through the network 10.

The entire network 10, including the network client 16 and the servers20 and 26, may also be hosted on a single computer if a distributednetwork is not required.

A point 18 may have a number of different virtual realityrepresentations served by a number of different VR data servers 20.These representations may be stored in different file formats, mayrepresent the point in different seasons of the year or in differenthistorical eras, or may provide an alternative or augmented visitorinterface or sensory experience. Of course, a particular data server 20could serve a number of virtual reality representations of a point 18 ordifferent points 18.

A domain server 26 hosts a universe database 30 for displaying the map12 and the points 18 on the map 12. The database 30 preferably includesgraphic files, image files, and other data for generating and displayingthe map 12. The universe database 30 may also include the networkaddresses or network paths to the VR files associated with the virtualreality representations.

The domain server 26 also maintains a network database 32 that storesinformation about each point 18 and the network addresses of the one ormore VR data servers 20 that provide access to VR representations of thepoint 18.

The network database 32 holds a number of virtual reality representationrecords (VRR records) 34.

FIG. 2 illustrates a typical VRR record 34. The VRR record 34 is a datastructure that provides information enabling the VR browser 14 to locatethe VR data server 20 providing access to a specific VR representation.A VRR record 34 includes the location of the point 18 and the networkaddress of the VR data server 20 associated with the VR representationof the point 18.

The VRR record 34 preferably also includes metadata providing additionalinformation about the point 18, the associated VR data server 20, andthe virtual reality representation of the point 18. Metadata can includethe author, VR file format, or a description of the VR representation.Other metadata can include digital rights management (DRM) information,initial orientation or direction of the default opening view of thevirtual reality representation, or the like. Other metadata can includeWWW Web Data strings, WWW Images Data strings and WWW News Data strings.

Each VR data server 20 maintains a local database 36 that records thelocation or locations of the VR data 24 accessed through the VR dataserver 20 (see FIG. 1). The local database 36 holds a virtual realityrecord (VR record) 38 for each representation accessed through the VRdata server 20.

FIG. 3 illustrates a typical VR record 38. The VR record 38 is a datastructure that includes the location of the point 18, the location ofthe VR data 24 for the representation of the point, and metadatacontaining further information about the VR data 24. For example, suchmetadata may include the author and digital rights management (DRM)information, VR data format, or descriptive information about the VRrepresentation. Other metadata can include WWW Web Data strings, WWWImages Data strings and WWW News Data strings.

The universe database 30, the network database 32, or a local database36 can be realized as a single-file relational database, objectdatabase, or hierarchal XML database. Alternatively, a database 30, 32,36 can be realized as a number of separate data files, wherein each datarecord is stored in a respective data file. The data file can be instructured text file format, XML format, or other conventional dataformat. The selection of database schema and format is based onconventional software engineering considerations, including the networkarchitecture, the network load, and available software.

FIG. 4 illustrates a first visitor session wherein a visitor 39 exploresthe virtual universe point-by-point. For clarity only one visitor isshown connected to the network 10, but it should be understood that anumber of visitors can simultaneously explore the universe.

The VR browser 14 retrieves the map data 30 from the domain server 26and begins the visitor session by displaying the map 12 shown in FIG. 1.The map 12 displays the points 18, and the visitor interface of the VRbrowser 14 enables the visitor 39 to select which point 18 and therepresentation of the selected point 18 he or she would like toexperience.

It should be understood that the universe database 30 may include orenable generation of a number of different maps representing differentregions or sub-regions of the universe. The VR browser 14 maysimultaneously or sequentially display different maps during a visitorsession. For example, the visitor is initially presented with a “mastermap” or model of the entire universe. If the virtual universe issufficiently extensive, the visitor interface of the VR browser 14enables visitors to “drill down” and select more detailed maps or modelsof sub-regions (for example, maps representing a continent, a country, acity, and then a city block) to select a desired point 18.

Map 12 should therefore be understood to represent all possible maps theVR browser 14 may display as part of its visitor interface. Maps may berepresentations of one-dimensional, two-dimensional, three-dimensional,or n-dimensional space as is appropriate for the virtual universe suchmaps represent.

The map 12 may also display additional information that assists thevisitor in selecting a point or a VR representation of the point. Forexample, the map might indicate points of historical interest or thenumber and types of virtual reality representations available for eachpoint.

In the illustrated embodiment, the visitor selects a desired point 18 afrom the map 12 by clicking the mouse (see FIG. 1). The browser 14determines the location of the selected point 18 a on the map andrequests a list 40 of VRR records 34 associated with that point from thedomain server 26 (see FIG. 2).

The domain server 26 queries the network database 32 for the list of VRRrecords of points at or proximate to the selected point 18 a. The domainserver 26 returns the VRR list 40 to the VR browser 14. The VR browser14 generates a list of available VR representations from the VRR list40, and displays the list for the selected point 18 a.

The display list can include information from the metadata to assist thevisitor in selecting a VR representation to experience. For example, theVR browser 14 might display an icon for each representation indicatingsome characteristic of the representation (such as season of the year,its VR file format, or quality moderation value (discussed in furtherdetail below)).

The visitor selects from the display list the desired virtual realityrepresentation to experience. If there is only one representationassociated with the selected point, the steps of displaying andselecting from the list can be eliminated.

The VR browser 14 uses the VRR record 34 associated with the selectedrepresentation to look up the network address of the VR data server 20providing access to the virtual representation. The VR browser 14requests the VR record 38 for the selected representation from the VRdata server 20. The VR browser 14 uses the returned VR record 38 tofetch the VR data file 24 and initialize a virtual reality presentationthat will be perceived and experienced by the visitor 39. For example,the VR browser 14 could start one helper application to display aQUICKTIME presentation and another helper application to display a VRMLpresentation.

In the illustrated embodiment, the VR browser 14 displays the map 12 ina first window and the virtual reality presentation in a second window(discussed in greater detail later). In other embodiments, virtualreality presentations could be displayed independently of the VR browser14 through more specialized or augmented VR hardware, such as a headset.

During the VR presentation, the VR browser 14 receives input from thevisitor and communicates with the VR data server 20 to fetch the VR data36. The visitor can change the point of view and move about thepresentation as permitted by the virtual reality representation beingexperienced. When the visitor ends the VR presentation, the windowdisplaying the VR presentation closes or goes blank. The visitor 39 canthen select a new point 18 or quit the application.

In addition to exploring selected points 18, the network 10 enables thevisitor 39 to explore paths through the universe. See, for example, path42 shown in FIG. 5. A path is defined as extending along a set of pointsor extending between start and end points in the universe. The network10 supports multiple types of paths as will be described in furtherdetail below.

A visitor sequentially experiences virtual reality presentations of thepoints 18 on the path. The VR browser 14 automatically moves fromdisplaying one VR presentation to the next in response to visitor inputindicating movement along the path. This provides the visitor with theperception of walking through or being “immersed” in the universe. Ifthe points 18 are sufficiently close together, the visitor willessentially perceive continuous or seamless movement through the virtualuniverse.

Path 42 represents a pre-defined path. A pre-defined path is definedprior to the visitor session and may, for example, represent a virtualriver, highway, or historical trail through the universe. Pre-definedpaths are preferably defined in the universe database 30 and representedon the map 12 for selection by the visitor 39.

FIG. 4A illustrates a second access of display data based upon accessingworld wide web data associated with the selected location. The firstvisitor session wherein a visitor 39 explores the virtual universepoint-by-point. For clarity only one visitor is shown connected to thenetwork 10, but it should be understood that a number of visitors cansimultaneously explore the universe.

The VR browser 14 retrieves the map data 30 from the domain server 26and begins the visitor session by displaying the map 12 shown in FIG. 1.The map 12 displays the points 18, and the visitor interface of the VRbrowser 14 enables the visitor 39 to select which point 18 and therepresentation of the selected point 18 he or she would like toexperience.

It should be understood that the universe database 30 may include orenable generation of a number of different maps representing differentregions or sub-regions of the universe. The VR browser 14 maysimultaneously or sequentially display different maps during a visitorsession. For example, the visitor is initially presented with a “mastermap” or model of the entire universe. If the virtual universe issufficiently extensive, the visitor interface of the VR browser 14enables visitors to “drill down” and select more detailed maps or modelsof sub-regions (for example, maps representing a continent, a country, acity, and then a city block) to select a desired point 18.

Map 12 should therefore be understood to represent all possible maps theVR browser 14 may display as part of its visitor interface. Maps may berepresentations of one-dimensional, two-dimensional, three-dimensional,or n-dimensional space as is appropriate for the virtual universe suchmaps represent.

The map 12 may also display additional information that assists thevisitor in selecting a point or a VR representation of the point. Forexample, the map might indicate points of historical interest or thenumber and types of virtual reality representations available for eachpoint.

In the illustrated embodiment, the visitor selects a desired point 18 afrom the map 12 by clicking the mouse (see FIG. 1). The browser 14determines the location of the selected point 18 a on the map andrequests a list 40 of VRR records 34 associated with that point from thedomain server 26 (see FIG. 2).

The domain server 26 queries the network database 32 for the list of VRRrecords of points at or proximate to the selected point 18 a. The domainserver 26 returns the VRR list 40 to the VR browser 14. The VR browser14 generates a list of available VR representations from the VRR list40, and displays the list for the selected point 18 a.

The display list can include information from the metadata to assist thevisitor in selecting a VR representation to experience. For example, theVR browser 14 might display an icon for each representation indicatingsome characteristic of the representation (such as season of the year,its VR file format, or quality moderation value (discussed in furtherdetail below)).

The visitor selects from the display list the desired virtual realityrepresentation to experience. If there is only one representationassociated with the selected point, the steps of displaying andselecting from the list can be eliminated.

The VR browser 14 uses the VRR record 34 associated with the selectedrepresentation to look up the network address of the VR data server 20providing access to the virtual representation. The VR browser 14requests the VR record 38 for the selected representation from the VRdata server 20. The VR browser 14 uses the returned VR record 38 tofetch the VR data file 24 and initialize a virtual reality presentationthat will be perceived and experienced by the visitor 39. For example,the VR browser 14 could start one helper application to display aQUICKTIME presentation and another helper application to display a VRMLpresentation.

In the illustrated embodiment, the VR browser 14 displays the map 12 ina first window and the virtual reality presentation in a second window(discussed in greater detail later). In other embodiments, virtualreality presentations could be displayed independently of the VR browser14 through more specialized or augmented VR hardware, such as a headset.

During the VR presentation, the VR browser 14 receives input from thevisitor and communicates with the VR data server 20 to fetch the VR data36 by selecting the WWW link representation. A request is made for theC=VR WWW data strings for the selected representation location. Thedatavase 36 is queried for the data strings. The database 36 returns theVR www Data strings. A search is then performed of the world wide webfor web data, images and news data. The VR representation is initializesand the visual representation is populated with webm news and imagedata.

It should be obvious that any other related web data can be associatedwith the VR representation.

The visitor can change the point of view and move about the presentationas permitted by the virtual reality representation being experienced.When the visitor ends the VR presentation, the window displaying the VRpresentation closes or goes blank. The visitor 39 can then select a newpoint 18 or quit the application.

In addition to exploring selected points 18, the network 10 enables thevisitor 39 to explore paths through the universe. See, for example, path42 shown in FIG. 5. A path is defined as extending along a set of pointsor extending between start and end points in the universe. The network10 supports multiple types of paths as will be described in furtherdetail below.

A visitor sequentially experiences virtual reality presentations of thepoints 18 on the path. The VR browser 14 automatically moves fromdisplaying one VR presentation to the next in response to visitor inputindicating movement along the path. This provides the visitor with theperception of walking through or being “immersed” in the universe. Ifthe points 18 are sufficiently close together, the visitor willessentially perceive continuous or seamless movement through the virtualuniverse.

Path 42 represents a pre-defined path. A pre-defined path is definedprior to the visitor session and may, for example, represent a virtualriver, highway, or historical trail through the universe. Pre-definedpaths are preferably defined in the universe database 30 and representedon the map 12 for selection by the visitor 39.

FIG. 5 illustrates the VR browser 14 with a first display window 46 anda second display window 50. Display window 46 displays the map 12, thepath 42, and the points 18 along the path 42 as shown. The second window50 displays the virtual reality presentation of the active, or currentlyvisited, point 18 b.

When displaying a virtual reality presentation of a point 18, the VRbrowser 14 preferably displays an icon 48 indicating the active point18. The illustrated icon 48 is an arrow that also indicates theapproximate direction of the current line of view of the virtual realitypresentation shown in the second window 50. Icon 48 is shown indicatingthat point 18 b is the active point and that the direction of thecurrent line of view is west.

Navigation widgets 52 associated with the first window 46 enable thevisitor to move along the path 42 or to move to a different path (suchas a second path 54). Navigation widgets 56 associated with the secondwindow 50 enable the visitor to change the line of view of the VRpresentation in the second window 50. Widgets 52 and 56 can be combinedinto a single control if desired, and alternative known interfacecontrols (including the mouse) or other interface widgets may replace orbe used with the widgets 52, 56.

Widget 57 is a link to obtain world wide web data for the specificvirtual reality location being viewed.

FIG. 5A illustrates the VR browser 14 with a first display window 46 anda second display window 50. Display window 46 displays the map 12, thepath 42, and the points 18 along the path 42 as shown. The second window50 displays the virtual reality presentation of the active, or currentlyvisited, point 18 b. It further shows Web data sub window 56A withscroll bars 56A1 and zoom widget 56A2. It further shows images data subwindow 56B with scroll bars 56B1 and zoom widget 56B2. It further showsnews data sub window 56C with scroll bars 56C1 and zoom widget 56C2. TheZoom widgets 56A2, 56B2 and 56C2 allow for the data in the sub windowsto be maximized in the entire display window 50 for clearer viewing andthen that window can be closed back to normal subwindow size.

When displaying a virtual reality presentation of a point 18, the VRbrowser 14 preferably displays an icon 48 indicating the active point18. The illustrated icon 48 is an arrow that also indicates theapproximate direction of the current line of view of the virtual realitypresentation shown in the second window 50. Icon 48 is shown indicatingthat point 18 b is the active point and that the direction of thecurrent line of view is west.

Navigation widgets 52 associated with the first window 46 enable thevisitor to move along the path 42 or to move to a different path (suchas a second path 54). Navigation widgets 56 associated with the secondwindow 50 enable the visitor to change the line of view of the VRpresentation in the second window 50. Widgets 52 and 56 can be combinedinto a single control if desired, and alternative known interfacecontrols (including the mouse) or other interface widgets may replace orbe used with the widgets 52, 56.

Widget 57A allows for return to FIG. 4 eliminating the WWW datasubwindows.

FIG. 6 illustrates a second visitor session in which the visitor movesalong and explores the path 42 (the database 36 and VR data 24 areomitted from the drawing). The VR browser 14 retrieves the map and pathdata from the universe database 30 and displays the map 12 as shown inFIG. 5.

The visitor selects the desired path 42, and the VR browser 14 obtainsthe VRR record list 40 for the points 18 on the path 42 from the domainserver 26. For simplicity, it is assumed that each point 18 on the path42 has only one virtual reality representation; so each VRR record 34 isassociated with a single point 18 on the path 42.

The VR browser 14 uses the VRR record 34 associated with the path'sstarting point 18 c to look up the network address of the appropriate VRdata server 20 and retrieves the VR record 38 from that server 20. TheVR record data is used to initialize and display the virtual realitypresentation of the first, or starting point 18 c (see FIG. 5). Widgets56 control the line of view of the virtual reality presentation asdescribed.

Widgets 52 move the visitor to the next, or second point on the path 42.The VR browser 14 uses the VRR record 34 associated with the next pointto retrieve VR data for the next point. If the points 18 along the path42 are sufficiently close, the transition from point to point appears tothe visitor as a continuous movement along the path.

In moving from the virtual reality representation of one point toanother, the VR browser 14 may also maintain (as closely as possible)the same line of view to maintain the appearance of continuous movement.For example, if the visitor is looking south and moves to the nextpoint, the initial line of view for the next point is also viewingsouth. In alternative embodiments, however, the VR browser 14 caninitialize each virtual reality presentation with a pre-determined ordefault line of view.

A second type of path preferably supported by the network 10 is aconnection path. A connection path is a dynamic path generated from anactive point 18 to adjacent points 18 during the visitor session. FIG.7a illustrates the map 12 displaying connection paths 58 extendingbetween an active point 18 d and adjacent points 18 e-18 i. Connectionpaths 58 connect two adjacent or neighboring points 18, enabling thevisitor to pick and choose his or her own route through the universe.

The connection paths 58 typically provide multiple routes betweenpoints. For example, the visitor can move from point 18 d to point 18 hdirectly, or can move first to point 18 g and then to point 18 h. FIG.7b illustrates the connection paths 59 when the visitor reaches point 18h. The paths 59 start from point 18 h and end at points 18 d, 18 g, and18 i.

The VRR record(s) 34 for each point 18 preferably includes a connectiondata set (see FIG. 2) that lists adjacent points 18. For example, theconnection data set for point 18 d (shown in FIG. 7a ) includes points18 e-18 i and the direction to each point. This enables the VR browser14 to display the connection paths 58 available to the visitor; the VRbrowser 14 can also iteratively retrieve the VRR records of adjacentpoints to display a network of available paths on the map 12. Theconnection data set also allows the VR browser 14 to efficiently respondand display the next virtual reality presentation after receiving avisitor request to move in a given direction from active point 18 d.

The domain server 26 generates the connection data set when a new point18 is added to the network. The adjacent points 18 are retrieved fromthe universe database 30 to generate the connection data set for the newpoint 18.

The domain server 26 also modifies the connection data set of adjacentpoints 18 as illustrated in FIGS. 8 and 9. The maps 12 in FIGS. 8 and 9are otherwise identical to the map 12 in FIG. 7a , but include alater-added point 18 j or 18 k, respectively. In FIG. 8, point 18 j isinserted between points 18 d and 18 h. Point 18 j is now adjacent topoint 18 d instead of point 18 h. The connection data set associatedwith point 18 d is modified to remove point 18 h and to insert point 18j for the connection path 58 extending between points 18 d and 18 j. InFIG. 9, point 18 k is an additional point adjacent to point 18 d. Point18 k is added to the data connection set associated with point 18 d forthe connection path 58 extending between points 18 d and 18 k.

A visitor can also preferably edit the connection data set for a point18 to add or subtract connection paths extending from the point. Thevisitor can add a remote point 18 to the data set, creating a connectionpath to that remote point. A point can be removed from the data set,eliminating a connection path. The modified data set can be stored onthe visitor's machine 16 for use only by the visitor's browser 14, orthe modifications can be saved in the network database 32 to be madeavailable to all visitors.

A third type of path supported by the network 10 is the event path. Anevent path is a dynamic path generated by the network in response to anevent or visitor query. For example, the visitor 39 may request the pathfrom his or her current location to another location in the universe.The VR browser 14 queries the universe database 30 and displays thepoints 18 along the path on the map 12.

FIG. 10 illustrates an event path 60 generated by an event. The domainserver 26 maintains a list of active visitors on the network 10 and thecurrent location of each visitor in the universe. The map 12 displaysthe positions of all the visitors 39 and the path to each visitor. Forclarity only two active visitors 39 a, 39 b and one path 60 between themare shown in FIG. 10. Paths 60 are automatically updated as visitorsmove about in the universe and as visitors join and leave the network.

A fourth type of path supported by the network is the visitor-definedpath. Path 54 (see FIG. 5) represents a visitor-defined path. Thevisitor defines the end points and the points 18 of the path 54. Thepath can be created, for example, by inputting a list of the points 18defining the path or by having the VR browser 14 maintain and store ahistory of the points 18 visited by the visitor in prior visits.

The definition of the visitor-defined path 54 may be stored on thevisitor's machine 16 for use only by the visitor 39. Alternatively, thepath definition is stored in the universe database 30 and made availableto all network visitors.

As described above, the domain server 26 provides a single point ofaccess for the VR browser 14 to initiate a visitor session and display amap of available points 18 in the universe. This enables new points 18to be added to the universe and new virtual reality representations ofnew or existing points 18 to be made available to all VR browsers 14 onthe network 10 by updating the domain server databases 30 and 32.

An author creating a virtual reality representation for a new orexisting point 18 stores the data on his or her own VR data server 20and then connects the VR data server to the network 10. The authorremotely invokes an administrative program on the domain server 26 thatadds the location to the universe database 30 and adds a new VRR 15record 34 to the network database 32. The new VRR record 34 includes thelocation of the new point 18 and the network address of the associatedVR data server 20. The VR browser 14 automatically generates anup-to-date map 12 when it retrieves the map data from the universedatabase 30.

If desired, the client machine 16 can cache VR data 34 as well asrecords from the databases 30, 32, and 36 for improved performance. TheVR browser 14 uses the local data cache to display the map and toretrieve VR data from the network 10. However, the data cache should berefreshed regularly or at the visitor's command to prevent stale data.Alternatively, the database records can include a “Time to Live” fieldfor automatic updating of the data caches.

To facilitate creation of VR representations of points 18, the universeis preferably divided into a public region and a private region. Authorsare free to add virtual reality representations of any point in thepublic region. Only authorized authors can add virtual representationsof private regions.

To illustrate the concept of public and private regions in more concreteterms, the map 12 is a virtual representation of the Gettysburg NationalMilitary Park 62 and the adjacent borough of Gettysburg, Pa. 64. SeeFIG. 1; the borough of Gettysburg is represented schematically as acircular area. The Military Park 62 is a public region of the universeand the borough of Gettysburg 64 is a private region of the universe.

Tourists or Civil War buffs can author a virtual reality representationfor a new point 18 in the Military Park 62 or author an additionalvirtual reality representation for an existing point 18. The author canprovide visitor access to the representation through a publicly orprivately available VR data server 20. The author updates the domainserver databases 30, 32 through the administrative software aspreviously described and updates the local database 36 and stores the VRdata 24 on the data server 20. The new point and its representation arenow available to all visitors.

Over time, the number of points in the universe having virtual realityrepresentations increases and the number of representations for a givenpoint increases. This enables visitors to select points and viewpresentations that provide them with a rich and varied virtual visit tothe virtual Military Park 62.

To further encourage the creation and selection of high-quality virtualpresentations, each representation of a public point 18 is preferablyassigned a quality moderation value. A quality moderation valuerepresents the quality of the representation and assists visitors inselecting which representations to view. The quality moderation value ispreferably stored in the representation's VRR record 34 (see FIG. 2) andis displayed on the map 12.

For example, a representation can be assigned a quality moderation valuebetween 0 and 10, where 0 represents a low quality representation and 10represents a high quality representation. A visitor can rate the qualityof the representation after 16 experiencing the virtual realitypresentation. A running average of visitors' ratings is stored as therepresentation's quality moderation value. This mechanism enables thenetwork 10 to be self-moderating in that representations whose qualityfalls below a minimum value can be automatically removed from thenetwork or not listed for selection.

Virtual reality representations of points within Gettysburg borough 64,however, are limited to authorized authors. Examples of such authors mayinclude owners of commercial establishments who wish to control thecontent of the virtual reality representation of their store orbusiness. A private representation may be hosted on a VR data server 20whose access is controlled by the author and may or may not be assigneda quality moderation value.

Virtual reality representations of public points are preferably createdin a simple, standardized format to encourage those without technical orcomputer expertise to contribute virtual reality representations to thenetwork 10.

FIG. 11 illustrates a preferred, simplified virtual reality format. Fourimages 66 are taken with a digital camera from a point, each photographhaving a line of view facing north, south, east, and west, respectively.The administrative program uploads the four image files and presents anon-line form requesting the location of the point and associatedmetadata. The administrative program stores the image files as VR data24 on a VR data server 20, updates the universe database 30, adds theappropriate VRR record to the network database 32, and adds theappropriate VR record to the local database 36.

Because the illustrated public region 62 represents an area of theEarth, the latitude and longitude of the corresponding physical locationof an actual point on the Earth's surface provides a convenient way ofidentifying the location of a point 18 on the map 12. The administrativeprogram requests the latitude and longitude of the point, which can beobtained, for example, by a GPS reading when the digital photographs aretaken.

It is understood that other kinds of metadata, data fields, data keys,or data formats can be used for or stored in the databases 30, 32, and36 and that other VR data 24 can be stored in other file formats. Thedata can be distributed on other servers on the network 10. But the VRbrowser 14 preferably accesses the network 10 initially through thesingle domain server 26 regardless of how the data itself is distributedthroughout the network 10.

It is contemplated that embodiments of the virtual reality network 10will be customized for particular industries or visitors. For example, areal estate network would host virtual reality representations of housesavailable for sale. The seller's real estate agent takes photographs ofeach room in a house and uploads them to the real estate network, alongwith the floor plan and other metadata. A buyer's real estate agentselects the house to visit, and the VR browser displays the floor planand the paths through the house. The visitor moves along the paths inthe house, in effect taking a virtual reality tour through each room inthe house.

The present invention may be implemented in an application that may beoperable using a variety of devices. Non-transitory computer-readablestorage media refer to any medium or media that participate in providinginstructions to a central processing unit (CPU) for execution. Suchmedia can take many forms, including, but not limited to, non-volatileand volatile media such as optical or magnetic disks and dynamic memory,respectively. Common forms of non-transitory computer-readable mediainclude, for example, a floppy disk, a flexible disk, a hard disk,magnetic tape, any other magnetic medium, a CD-ROM disk, digital videodisk (DVD), any other optical medium, RAM, PROM, EPROM, a FLASHEPROM,and any other memory chip or cartridge.

Various forms of transmission media may be involved in carrying one ormore sequences of one or more instructions to a CPU for execution. A buscarries the data to system RAM, from which a CPU retrieves and executesthe instructions. The instructions received by system RAM can optionallybe stored on a fixed disk either before or after execution by a CPU.Various forms of storage may likewise be implemented as well as thenecessary network interfaces and network topologies to implement thesame.

While we have illustrated and described preferred embodiments of ourinvention, it is understood that this is capable of modification, and wetherefore do not wish to be limited to the precise details set forth,but desire to avail ourselves of such changes and alterations as fallwithin the purview of the following claims.

What is claimed is:
 1. A system for enabling a visitor to access virtualreality (VR) representations, the system comprising: memory for storinga plurality of VR data sets, each of the VR data sets defining a VRrepresentation of a location and including data strings for queryingworld wide web data sources for a plurality of different types ofinformation about the location of the respective VR representation, thedata strings including image data strings used to query for an imagetype of information about the location; one or more VR data servers,each VR data server associated with one of the VR data sets; a domainserver that transmits a network address of each VR data server and therespective data strings in the associated VR data set; and a client hostthat communicates with the domain server to: receive the network addressof the VR data server associated with the VR data set identified for aselected location, retrieve the VR data set identified for the selectedlocation from the VR data server at the network address, use the datastrings included in the retrieved VR data set to perform a new search ofthe world wide web data sources associated with the VR data set, andgenerate an updated VR representation based on the retrieved VR data setthat includes different types of information that have been retrievedbased on the new search about the selected location without leaving thevirtual universe, wherein the different types of information that havebeen retrieved based on the new search are displayed in a plurality ofsub windows, and each different type of information that has beenretrieved is displayed within a respective different sub window, atleast one of the sub windows specific to image data retrieved based onthe image data strings.
 2. The system of claim 1, wherein the new searchfor the plurality of different types of information retrieved from theworld wide web data sources is performed in real-time.
 3. The system inclaim 1, wherein the new search further retrieves the plurality ofdifferent types of information from the world wide web data sources thatinclude at least one of news, images, or other data.
 4. The system ofclaim 1, wherein the domain server, the one or more data servers, andthe client host comprise a plurality of computers with at least oneserver having access to the world wide web data sources for searching.5. The system of claim 1, wherein each of the one or more data serversstores a database of the locations of the virtual realityrepresentations and the data strings for web, news, and image dataaccessible through the data server and the network addresses of the VRdata sets defining such virtual reality representations, and wherein VRdata sets can be stored remotely from the data server.
 6. The system ofclaim 1, wherein at least one of the VR data sets includes first datarepresenting a plurality of photographs wherein each photograph is takenin a respective viewing direction, and second data representing theviewing direction of each photograph.
 7. The system of claim 1, furthercomprising an interface that receives updates to the domain data withthe network address of the data server, the location in the virtualreality universe associated with the retrieved VR data set, and the datastrings for the plurality of different types of information.
 8. Thesystem of claim 1, wherein at least one of the VR data sets includes aphotograph taken from a geographical location and one or more datastrings for the plurality of different types of information.
 9. Thesystem of claim 1, wherein the sub windows are associated withnavigational widgets.
 10. The system of claim 1, wherein at least one ofthe stored plurality of VR data sets is updated over time to include atleast one new image data string for querying new image data pertainingto the location.
 11. The system of claim 10, wherein the at least onenew image data string is added by an author of the at least one storedVR data set.
 12. The system of claim 1, wherein retrieving the VR dataset for the selected location includes making a request for the imagedata strings of the VR data set for the selected location.
 13. Thesystem of claim 12, wherein making the request for the image datastrings of the VR data set for the selected location includes queryingthe VR data server at the network address for the image data strings.14. A method for enabling a visitor to access virtual reality (VR)representations, the method comprising: storing a plurality of VR datasets that each define a VR representation of a location and include datastrings for querying world wide web data sources for a plurality ofdifferent types of information about the location of the respective VRrepresentation, the data strings including image data strings used toquery for an image type of information about the location; receivingdata from a visitor device representing a selected location in thevirtual universe; receiving a network address of each VR data server andthe respective data strings in the associated VR data set; retrievingthe VR data set identified for the selected location from the VR dataserver at the network address; using the data strings included in theretrieved VR data set to perform a new search of the world wide web datasources associated with the VR data set; and generating an updated VRrepresentation based on the retrieved VR data set that includesdifferent types of information that have been retrieved based on the newsearch about the selected location without leaving the virtual universe,wherein the different types of information that have been retrievedbased on the new search are displayed in a plurality of sub windows, andeach different type of information that has been retrieved is displayedwithin a respective different sub window, at least one of the subwindows specific to image data retrieved based on the image datastrings.
 15. The method of claim 14, wherein the new search for theplurality of different types of information retrieved from the worldwide web data sources is performed in real-time.
 16. The method of claim14, wherein at least one of the VR data sets includes first datarepresenting a plurality of photographs, wherein each photograph istaken in a respective viewing direction, and second data representingthe viewing direction of each photograph.
 17. The method of claim 14,further comprising receiving updates via an interface to the domain datawith the network address of the data server, the location in the virtualreality universe associated with the retrieved VR data set, and the datastrings.
 18. The method of claim 17, further comprising updating theretrieved VR data set based on received updates.
 19. A virtual realityviewing system for viewing virtual reality (VR) locations in a virtualuniverse accessed through a computer network, the viewing systemcomprising: memory that stores: a plurality of VR data sets that eachdefine a VR representation of a location and include data strings forquerying world wide web data sources for a plurality of different typesof information about the location of the respective VR representation,the data strings including image data strings used to query for an imagetype of information about the location, and data representing a map ofthe locations in the virtual universe represented by the plurality of VRdata sets; an interface that: receives input for selecting a locationdisplayed on the map, the location represented by one of the pluralityof VR data sets, receives a network address of a network data serverproviding access to the VR data set representing the selected location,and communicates with the network data server at the network address toreceive the VR data set; and a processor that executes instructionsstored in memory, wherein execution of the instructions by theprocessor: uses the data strings included in the retrieved VR data setto perform a new search of the world wide web data sources associatedwith the VR data set, and generates an updated VR representation basedon the retrieved VR data set that includes different types ofinformation that have been retrieved based on the new search about theselected location without leaving the virtual universe, wherein thedifferent types of information that have been retrieved based on the newsearch are displayed in a plurality of sub windows, and each differenttype of information that has been retrieved is displayed within arespective different sub window, at least one of the sub windowsspecific to image data retrieved based on the image data strings.
 20. Anon-transitory computer-readable storage medium having embodied thereona program executable by a processor to perform a method for enabling avisitor to access virtual reality (VR) representations, the methodcomprising: storing a plurality of VR data sets that each define a VRrepresentation of a location and include data strings for querying worldwide web data sources for a plurality of different types of informationabout the location of the respective VR representation, the data stringsincluding image data strings used to query for an image type ofinformation about the location; receiving data from a visitor devicespecifying a selected location in the virtual universe; receiving anetwork address of the VR data server that stores the VR data set forthe selected location; retrieving the VR data set for the selectedlocation from the VR data server at the network address; using the datastrings included in the retrieved VR data set to perform a new search ofthe world wide web data sources associated with the VR data set; andgenerating an updated VR representation based on the retrieved VR dataset that includes different types of information that have beenretrieved based on the new search about the selected location withoutleaving the virtual universe, wherein the different types of informationthat have been retrieved based on the new search are displayed in aplurality of sub windows, and each different type of information thathas been retrieved is displayed within a respective different subwindow, at least one of the sub windows specific to image data retrievedbased on the image data strings.